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Abstract 

A mapping of fc-bit strings into n-bit strings is called an (a,/3)-map if k- 
bit strings which are more than ak apart are mapped to u-bit strings that 
are more than (3n apart. This is a relaxation of the classical problem of 
constructing error-correcting codes, which corresponds to a = 0. Exis¬ 
tence of an (a,/5)-map is equivalent to existence of a graph homomorphism 
H{k,ak) -A- H{n,Pn), where H{n,d) is a Hamming graph with vertex set 
{0,1}” and edges connecting vertices differing in d or fewer entries. 

This paper proves impossibility results on achievable parameters (a, ff) in 
the regime of n, k ^ oo with a fixed ratio f = P- This is done by developing 
a general criterion for existence of graph-homomorphism based on the semi- 
definite relaxation of the independence number of a graph (known as the 
Schrijver’s 6'-function). The criterion is then evaluated using some known and 
some new results from coding theory concerning the 6'-function of Hamming 
graphs. As an example, it is shown that if f3 > 1/2 and ^ - integer, the 
^-fold repetition map achieving a = f3 is asymptotically optimal. 

Finally, constraints on configurations of points and hyperplanes in pro¬ 
jective spaces over F 2 are derived. 
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1. Introduction 


Hamming space F 2 of binary fc-strings, equipped with the Hamming dis¬ 
tance is one of the classical objects studied in combinatorics. Its properties 
that received significant attention are the maximal packing densities, cover¬ 
ing numbers, isoperimetric inequalities, list-decoding properties, etc. In this 
paper we are interested in studying metric properties of maps / : F 2 —)■ Fg 
between Hamming spaces of different dimensions. 

Indeed, frequently one is interested in embedding F 2 into F 2 “expan¬ 
sively”, i.e. so that points that were far apart in F 2 remain far apart in F^. 
Two immediate examples of such maps are: the error-correcting codes with 
rate k/n and minimum distance d satisfy 

|a:-a:'|>0 ^ |/(x) -/(x')| > d, 

where here and below \z\ = ||z||o = |{i : z, 7 ^ 0}| is the Hamming weight of 
the vector. Another example is the repetition coding with f{x) mapping x 
into ^ repetitions of x. This map satisfies: 

\x — x'\>ak \f{x) — f{x')\>an. ( 1 ) 

With these two examples in mind, we introduce the main concept of this 
paper. 

Definition 1. A map / : F 2 —?■ F 2 is called an {a, (3] k,n)-map (or simply 
an {a, (3)-map) if ak and fdn are integers and for allx,x' G Fg we have either 

\f{x) — f{x')\>l3n or \x — x'\ < ak, (2) 

where is the Hamming space of dimension k over the binary field. 

We next define the Hamming graphs H{n,d) for integer d G [0,n] as 
follows: 

V{H{n,d)) = E{H{n,d)) = {{x,x'):0<\x-x'\<d}. (3) 

By V (G), E{G) and (G) we denote the vertices of G, the edges of G and the 
cardinality of the maximal independent set of G. All graphs in this paper are 
simple (without self-loops and multiple edges). By G we denote the (simple) 
graph obtained by complementing E{G) and deleting self-loops. 
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The relevance of Hamming graphs to this paper comes from the simple 
observation: 


3(a,/3;/c, n)-map H{k,ak) ^ H{n, (3n), 

where G ^ H denotes the existence of a graph homomorphism (see Section [3] 
for dehnition). 

This paper focuses on proving negative results showing impossibility of 
certain parameters (q;,/ 3). Note that there are a variety of methods that we 
can use to disprove existence of graph homomorphisms. For example, by 
computing the shortest odd cycle we can prove 

H{2, 0) H{4, 2) H{6, 4) H{8, 6) /> • • • . 

In this paper, however, we are interested in the methods that provide some 
useful information in the asymptotic regime of/c—?- cxd,^—)" p>0 and hxed 
{a,13). 

1.1. More on the concept of an {a, l3)-map 

Our original motivation for Dehnition [T] was the following. Suppose the 
map / : F 2 —)■ Fg is used to protect the k data bits against noise. If the 
points X, x' G F 2 are far apart but f{x) and f{x') are close, i.e. if a map fails 
to satisfy (E]), then f[x) may be confused with f{x') in a noisy environment. 
Consequently, this would lead to a severe discrepancy if x' is reported instead 
of X. 

Below we briehy discuss how (a,/9)-property relates to some previously 
studied concepts. 

First, a (0, /3)-map is simply an error-correcting code of rate k/n and min¬ 
imum distance l+fln. Thus, {a, /3)-condition is a relaxation of the minimum- 
distance property: the separation of l-\-f3n is only guaranteed for data vectors 
X, x' that were 1 + ak apart to start with. Practically, data may have some 
structure guaranteeing some separation between feasible data-vectors (e.g. if 
X is English test, changing one letter is unlikely to result in a grammatically 
correct phrase). 

Second, in the inverse problem of reconstructing x from a noisy version 
y = f{x) -f z, one may proceed by computing a pre-image of the Hamming 
ball of radius /3n/2 around y. Then the (a,/3)-condition guarantees that the 
points in the pre-image will all be close to each other. 
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Third, an (a,/9)-map can be used to convert a code with (normalized) 
minimal distance > a to a code of minimal distance > /3 at the expense 
of losing a factor k/n in rate. This observation leads, on one hand, to a 
non-trivial bound on achievable parameters (a,/?), see (|9]) below. On the 
other hand, it also suggests that (a, /9)-maps could be employed for adapting 
properties of a fixed mother code to the changing noise environment. 

Fourth, an (Q!,/9)-map with n < k can be seen as a type of hashing 
in which one wants the hashes of dissimilar strings to be also dissimilar. 
In fact, the /3)-condition is weakening of the locality-sensitive hashing 
condition [l|, 0] . 

Finally, relaxation of the minimum-distance property taken in Definition[T] 
may be motivated by availability of the redundancy in the fc-bit data. In 
information theory transmitting such data across a noisy channel is known 
as the joint source-channel coding (JSCC) problem. Combinatorial variation, 
cf. j^, 1^, can be stated as follows: say that / : F 2 —)■ Fg is a {D, 5)-JSCC if 
there exists a decoder map 5 ^ : F 2 —)■ Fg with the property 

Vx e F 2 , 2 ; e F 2 : \f{x) — z\<6n \x — g{z)\ < Dk . 

The operational meaning is that a {D, (5)-JSCC reduces the (adversarial) 
noise of strength 6 in n-space to (adversarial) noise of strength D in /c-space. 
A special case oi D = eS was introduced by Spielman under the name 
of error-reducing codes. The connection to Def. [T] comes from the simple 
observation: 


/ is a (iJ, (5)-JSCC / is a (2iJ, 2J)-map . 

Thus, every impossibility result for (a,/9)-maps implies impossibility results 
for (D, (5)-JSCC and Spielman’s error-reducing codes. 

2. Main results 

For a = 0 the best known bound to date is due to McEliece et al j^. It 
says that any set S' C F 2 with \y — y'\ > 6n for all y,y' E S,y y' satisfies 

-logl^l <i?LP2(<5) + 0 (l), (4) 

n 

where RLP 2 {d) = 0 for J > 1/2 and for 5 < 1 / 2 : 

RLP2iS) = mm{l - h{a) + h{l3)), (5) 
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where h{x) = —x\ogx — (1 — x) log(l — x) and the minimum is taken over 
all0</3<a<l/2 satisfying 

^ a(l -g) -/j(l -/j) ^ ^ 
l + 2V/3(l-/3) - 

For distances 5 < 0.273 the solution is given by a = 1/2 and Rlp2{5) has a 
simpler expression: 

RLPi{5) = h{l/2-^5{l-5)). (6) 

Thus from (|1]) we get 

3(0,/3; /c,n)-map ^ k/n < Rlp2{I3) ■ 


A natural question is whether going from a = 0 to a > 0 may enable larger 
rates /c/n > Rlp2{(3)- 

The hrst impulse could be that the answer is negative. Indeed, note that 
for g < 1/2 there is points x' s.t. \x — x'\ > ak. Thus it may seem 

that for g < 1/2 this relaxation yields no improvements (asymptotically) 
compared to g = 0. This observation is incorrect for two reasons. First, we 
do not require / to be injective — thus although all points f{x') are far from 
f{x), they may not all be distinct. Second, even though each x has many x' 
satisfying \x — x'\ > ak, we in fact need a collection S' C s.t. \x — x'\ > ak 
for all pairs x,x' G S. Only then we may conclude that /(S') is code in F^ 
with large minimal distance. 

Thus, S' needs to be an independent set in H{k,ak). How large can it 
be? To that end, we recall Turan’s theorem, cf. [3, Theorem IV.6]: 


(G)> 


2(|i?(G)| + |V(G)|)- 


( 7 ) 


Counting the number of edges of the graph H{k,ak) via Stirling’s formula 
we get \E{H{k,ak))\ = 2^ ^(^) = Therefore, 


{H{k, ak)) > 


{Tf/2 


\E{H{k,ak))\^2'^ 

Consequently, if an (g,/?)-map exists then comparing 


_ r^{\-h{pL))Po{k) ^ 

and (0) we get 


k{l - h{a)) + o{k) < nRLP2{f3) + o{n). (9) 
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One natural way to improve the bound would be to notice that graphs 
H{k, ak) have a lot of extra structure and perhaps simplistic estimate ([H]) via 
Turan’s theorem can be improved. Unfortunately, despite decades of work the 
lower bound ([8]), known as the Gilbert-Varshamov bound, is asymptotically 
the best known. (For non-binary alphabets, however, better bounds exist j^.) 

Instead, the next theorem improves ([2]) by establishing how another graph- 
function (the ^-function, see fET]) below) behaves under graph homomor- 
phisms, and then applying known results on 0-function forJdamming graphs 
established by Samorodnitsky j§, [l^ and McEliece et ah 

Theorem 1. For every e > 0 there exist a sequence 
(a,/3; k,n)-map exists with a > e and fd > e then 


0 s.t. if an 


kRsam{a) + kdk < nRLP2{(d) + ndn 


( 10 ) 


and 


k 1-h 


-|- k6k < n { 1 — h 


+ n6„ 


( 11 ) 


where 

Rsam{a) = ^ max (^1 - h{a) + i?LPi(a), h{l - 2^ya{l - a))j (12) 
for a < 1/2 and zero otherwise. 

Remark 1. The hound flTOD is better for n/k > 1, while (ITT]) is better for 
n/k < 1. See Section\^for evaluations. 

Note that by virtue of relying only on the number of edges in H{k^ ak) the 
bound in dH]) is robust in the sense that whenever (a, (3) violate ([2]), there will 
be great many pairs of x,x' that violate (Ej). Here is a similar strengthening 
of Theorem [TJ 

Theorem 2. For every e > 0 there exist a sequence 5^ — t 0 with the 
following property. For every map / : F 2 —)■ F 2 , every S (Z F 2 of size 
1^1 ^ and every a,ld e [e, 1] satisfying 

kRsamia) -ke> nRLP 2 {fd) (13) 
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or 


there exists a pair x,x' E S such that 

\x — x'\ > ak and \f{x) — f{x')\<(3n. (15) 

In particular, there are at least un-ordered pairs C F 2 

satisfying 03, 


Next we consider an improved bonnd for the case of /? > 1/2. Notice that 
by Plotkin bonnd [ll[ Chapter 2.2] we have 


{H{n,(In)) < 1 + 


n 

2/9n + 2 — n 


In particular, H{n,Pn) does not contain K 4 whenever fl > 2/3. Therefore, 
any graph G which contains K 4 cannot map into H{n,f3n). For example: 

H{3,1) H{n,Pn) Vn G Z + , /3 > 2/3 . 


The following elaborates on this idea: 


Theorem 3. For every e > 0 there exists 6m ^ 0 such that if there exists 
an {a, /9; k, n) map with (d > \ and a E [| + e; 1 — e] then 

a>/3+ . (16) 

Furthermore, for any map / : F 2 —)■ F 2 , any jd > 1/2 and a E [| + e; 1 — e] 
and any set S' C F 2 0 / size 


|F| > 2^ 


W 

2 / 3-1 


2a 

2a-l 


— 6k 


there exists a pair of points x,x' E S satisfying (Iig, 
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Remark 2. Considering the argument preceding the theorem, it should not 
be so surprising that the relation between a and (3 in ([TB]) is independent of 
the rate ^. The significance of ffT6l) is that for the case of ^ E Z this bound 
is (asymptotically) optimal, as the example of the repetition map (II]) clearly 
shows. For linear {a, P)-maps the result was shown in Theorem 8] by 
studying properties of the generator matrix. 

When applied to linear maps Fg —)■ F 2 Theorems [2] and [3] have the fol¬ 
lowing geometric interpretations: 

Corollary 4. For every e > 0 there exists a seguence 5^ —)■ 0 with the fol¬ 
lowing property. Fix any two lists of (possibly repeated) points Ui,... ,Uk and 
Vi,... ,Vn in projective space P™'“^(F 2 ) s.t. that they are not all contained in 
a codimension 1 hyperplane. Fix any a,(3 E [e, 1] s.t. 

m>k{l- Rsam{o) + 4) n{RLP2{(3) 4) (17) 

or 

m > k{h {a/2) 4) + ’^(l — h(/5/2) -f 4) • (18) 

There exists a hyperplane H of codimension 1 in such that 

#{j : Vj E H} > (1 — (3)n , )f{i : Ui E H} < (1 — a)k or = k. (19) 

Corollary 5. For every e > 0 there exists 4—^0 with the following property. 
Fix any two lists of (possibly repeated) points ui,... ,Uk and vi,... ,Vn in 
projective space P”^“^(F 2 ) s.t. that they are not all contained in a codimension 
1 hyperplane. Fix any j3 > 1/2 and a E [\ + e]l — e] s.t. 

m>k + log, ^ - log, - 4 ) . (20) 

Then there exists a hyperplane H of codimension 1 in p™-“^ satisfying (IT3]) . 

Note that by identifying homogeneons coordinates with affine coordinates 
we can establish set-isomorphism P”*“^(F 2 ) and F™ \ {0}. Thns, previons 
corollaries can be eqnivalently restated in terms of Y'fi. For example, for any 
e > 0, all k snfficiently large and all n\ Fix some basis of ¥2 arbitrary non¬ 
zero points Vi,... ,Vn E F 2 . Then there exists a {k — l)-subspace containing 
> j v-points and < {\ + ^) k basis vectors. Note that this is a manifestly 




F2-property since over large fields one could select n-points (when n > Ak) 
so that no ^ of them are contained in a (fc — l)-subspace. 

The rest of the paper is organized as follows: Section[3]proves a few results 
on graph homomorphisms. In Section 0] these results are applied to prove 
Theorems mis] and Corollaries HHSl We conclude in Section [5] with discussion, 
numerical evaluations and some open problems. 

3. Graph homomorphisms 

Let us introduce notation to be used in the remainder of the paper: 

9s{G) = max{tr JM : tr M = 1, M ^ 0, M\e{g) = 0, > 0 Vu, v'} (21) 

= min{A^^(C') -.0 = 0^, C'U(g). > 1} ( 22 ) 

9l{G) = max{tr JM : tr M = 1, M ^ 0, M\e{g) = 0} (23) 

= min{A^a.(G) ■. G = G^, G\EiGY = 1} , (24) 

where M is a positive-semidehnite matrix of order |I/(G)|, J is an all-one 
matrix of the same size, Amax(') denotes the maximal eigenvalue and M\s 
denotes a subset {Mi^j : (i,j) G S} of the entries of matrix M, so that 

M\e(g) = {Mij : i j in Gj. 0s{G) and 0l{G) are the Schrijver and 

Lovasz 6*-functions, respect iveljo. 

We recall a few properties of the 0-function (one may consult [l^ for 
more): 


• Both 0-functions are typically used to upper bound the independence 
number of a graph: 


(G)<0s(G')<0l(G). 


(25) 


0 l(-), while yielding a looser bound on (•), is multiplicative under 
strong product of graph^ as shown in 13]: 


eL{GMH) = eL{G)eL{H). 


(26) 


^Other authors write 9{G) for 0l[G) and any of 9'{G), 0i/2(G) or 9 (G) for 9s{G). 
^The strong product G M H is a simple graph with vertex set given by V (G) x V(H) 
and edges (gi, hi) ~ {g2, /12) : (51 ~ 92 or gi = 32) and {hi ~ /12 or hi = h2). 
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(27) 


• For a vertex transitive graphs, we also have reciprocity [13 


9L{G)eL{G) = \V{G)\. 


Our main technical contribution in this section is the following partial gen¬ 
eralization of (l26l) - (l27D to 9s- 

Lemma 6. Let G be vertex transitive, then 



( 28 ) 


Proof is given at the end of this section. We next discuss its application to 
existence of graph homomorphisms. 

The graph homomorphism / : X —)■ T is a map of vertices of X to vertices 
of Y such that endpoints of each edge of X map to the endpoints of some 
edge in Y. If there exists any graph homomorphism between X and Y we 
will write X ^Y. The problem of finding f : X ^ Y is known as Wcoloring 
problem. 

For establishing properties of graph homomorphisms it is convenient to 
introduce homomorphic product jl4l)d: graph X x F" is a simple graph with 
vertices V{X) x V{Y) and {xi,yi) ~ (x2,|/2) if Xi = X 2 or xi ~ X 2 ,yi 7^ y 2 - 
From (|25|) and dehnition of X x T we have: 


(X X y) < 9s{x X y) < 9l{x X y) < |y(x)| 


and 



We overview some of the well-known tools for proving X -/^Y\ 

• (No-Homomorphism Lemma [l^) If X ^ y and Y is vertex transitive 


then 


_PO_>_(rL 

|y(x)| - |y(y)|' 


(29) 


• (Monotonicity of ) If X —)■ y then 

(X)< (Y) 


(30) 


^Note that 0 instead defines hom-product X oY which corresponds to X v.Y. 
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• (Monotonicity oi 9) \i X then 


9l{X) < eL{Y) (31) 

es{x)<es{Y). (32) 

• (Homomorphic product) If X —)■ H then 

9s{XkY) = \V{X)\ (33) 

eL{XKY) = \V{X)\. (34) 


Note that fl3Tl) - fl341) give necessary conditions for X ^ Y. Although, gen¬ 
erally not tight, these conditions can be understood as elegant relaxations 
(semi-dehnite, fractional, quantum etc) of the graph homomorphism prob¬ 


lem, cf. [16|, llJ, Il7|, [181, [19 


Inequalities (I29|) - fl34|) are useful for showing X Y. If X 74 H it is 
natural to ask for a quantity measuring to what extent X fails to homomor- 
phically map into Y. One such quantity is (X k Y), since 


(X K y) = max{|I/(G)| : G- induced subgraph of X s.t. G ^Y} . (35) 


Indeed, by construction any independent set S' in X x X has at most one 
point in each hber {xq} x Y and thus projection V{G) = proji(S') onto X 
always yields an induced subgraph G <Z X satisfying G ^ Y. With (1551) in 
mind, the next set of results will allow us to assess the degree of failure of 
X 74 y. 


Theorem 7. If X is vertex transitive, then 


(X >< y) 
Os{x X y) 

e^x X y) 


< |r(v)| « 

(36) 


(37) 

< \v{x)ffj~- = »L(x)edY). 

9l{X) 

(38) 
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IfY is vertex transitive, then 


(X K Y) < |V(y)|-|^ (39) 

0s(.X K Y) < (40) 

0dXxY)<\V{Y/^^^0dX)eL{Y). (41) 

Remark 3. One may view (I36l) - (j38l) as a quantitative version of criteria ioD- 
(132|) and (l3^ - (l4Ti) as a quantitative version of no-homomorphism lemma ([29]). 
Note also that the right-most versions of (1^ and (|4Ti) hold without any tran¬ 
sitivity assumptions Theorem 17]: For any X,Y 

eL{XKY)<eL{x)eLiY). (42) 

Proof. The proof relies on the following simple observation; The strong 
product X ^Y oi X and F - is a subgraph of X t< Y. Thus by edge- 
monotonicity: 

,es,eLixiKY)< ,es,eLiXMY). 

From here the results on and 6 s follow from Lemma [6] with G = X, 
H = Y (for (l36|) and (l37|) l or G = F and H = X (for (l3^ and (IT0|) L For 
9l the equality parts of fl38l) and fjTTl) follow from the results of Lovasz fl26l) 
and . □ 


One of the classically useful methods in coding theory is the Elias-Bassalygo 
reduction: From a given code in Ff] one selects a large subcode sitting on a 
Hamming sphere of a given radius. One then bounds minimum distance (or 
other) parameters for the packing problem in the Johnson graph J{n,d,w). 
It so happens that taking a simple dual certificate for 9s{J{n,d,w)) and 
transporting the bound back to the full space results in excellent bounds, 
which are hard (but possible - see Rodemich theorem in j^, p. 27]) to ob¬ 
tain by direct SDP methods in the full space. Succinctly, we may summarize 
this as follows: If G' is an induced subgraph of a vertex transitive G then 

(G).9s(G).9i(G)<FM (G'),es(G'),«i(G') resp. 

Here is a version of the similar method for the graph-homomorphism 
problem and for the problem of finding independent sets in G Kl 77; 
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Proposition 8. Let G be a vertex transitive graph and G' its induced sub¬ 
graph. Then 


{G^H)< 
OsiG^H) < 


l^(g)l 

|P(G')| 

l^(g)l 

|P(G')| 


(G" K H) 

OsiG'^H) 


(43) 

(44) 


and same for Ol- 

Proof. Let L be the group of automorphisms of G. The action of T natu¬ 
rally extends to the action on G^ H via: 

7 ( 9 , h) = {i{g),h). 

Let S be the maximal independent set of G^ H. Consider the chain: 

' ' 7Gr 

^W\ H 1{7(9)=j'}1{(j'.A)6S}1{J6G'} 

7Sr,g,g',h, 

|P(G)| ’ 

where fj45ll follows since each 7(5) (1 G' ^ H is an independent set of G' Kl 
H, fl46|) is obvious, and fl47)) is because by the transitivity of the action of L: 
1(7(5') = 9 '} = v^- Clearly, fl47|) is equivalent to (143|) . 

For (1441) let M = S'!) 5'2 ^ G,hi,h 2 G H) be the maximizer 

in fl2T]) . Symmetrizing over F if necessary we may assume that 

Mghi,gh 2 = Mgihi,g>h 2 '^9i9' ^ G, hi, h 2 E H (48) 

^gihi,g 2 h 2 = M'r(gi)hi,-yig 2 )h 2 ^ 9 ly 92 G G, hi, ^2 G Ff, V7 G F (49) 

Last equation also implies that the subspace spanned by vectors 1 g <8) (•) is 
an eigenspace of M. Here and below 1 g, fn are all-one vectors of dimensions 
|1/(G)| and \V{H)\ respectively. And 1 g' is a zero/one vector of dimension 
|P(G)| having ones in coordinates corresponding to vertices in G'. 


(45) 

(46) 

(47) 
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Set 


M. 


gihi,g 2 h 2 


l^(g)l 

\V{G')\ 


M, 


31 ^ 1 , 52/12 


92 £ G', hi,h 2 E H. 


One easily verifies that M is a feasible choice for the primal program flMll 
for 6 s{G' M H). To compute tr JM we notice that 

ti JM = {Mlc ^ 1h, 1g' ® If/) , (50) 

where (•, •) is a standard inner product on (g) rTWI. Finally, observe 

that orthogonal decomposition 


LG' L*) i-H 


Iff — clf 


Lff 


(1( 


Clf 


Lff : 


C = 


l^(G')l 


remains orthogonal after application of M, cf. 
positivity M ^ 0 that 


|f-(G)| 
Therefore, we get by 


(Mlc' 0 Iff, 1 g' Iff) > c^{M1g 0 Iff, 1 g Iff) = ti JM, 
which together with (1501) completes the proof of (011). 


□ 


Corollary 9. Let X' and Y' he induced subgraphs of X and Y, respectively. 
If X is vertex transitive then 


(X K y) < 

If Y is vertex transitive then 

{X kY)< 


l^(^)l 

|y(X')| 


l^(y)l 

|y(y')l 


{X' K Y). 


{X X Y'). 


Proof (Lemma [6|). We will give an explicit proof by exhibiting a choice of 
C in (12^ for computing 6 s{G Kl H). 

Let M be the optimal (primal) solution of (12T]) for 9s{G) and let G be 
the optimal (dual) solution of (l22|) for 9s{II). We know: 


ti JM = 9 s{G),X^UG) = 9s{H). 
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and also from the vertex-transitivity of G without loss of generality we may 
assume that 




tr JM 

|VM ’ 


where 1 is an all-one vector. We now dehn^ 


C = cil + C 2 M ®{G- + 


(51) 


where as before J denotes the square matrix of all ones (of different dimension 
depending on context) and 


A Xm.AC)\V{G)\ \V{G)\^ 

tr JM ’ tr.JM ' 


(52) 


We will prove that C* is a feasible choice in the (dual) problem (|2^ for 
Os{G Kl H). Then we can conclude that since M ^ 0 and G — Aniax(C')/ ^ 0 
that 


C :< Cil — C 2 M ^ J + J = Cil — {C 2 M — J) (g) J ^ ciJ (53) 
since by construction C2M — J ^ 0 (recall that M and J commute). Thus, 

\V{G)\es{H) 


Amax(C*) ^ Cl 


05(G) 


proving (l37)) . To verify that C is feasible dual assignment, we need to show 

(54) 


g = g\h= h', or 
Cgh,g'h'>^ ^gth,g',h'I g ^ g',g g', or 


which follows since E{G^Hy consists of all self-loops and edges connecting 
pairs that are non-adjacent (and non-identical) in either G or hf-coordinate. 
To verify fl5TD we recall that M and G satisfy 


> 0 \/g,g' 

Mg^g> = 0 \/g rjL g' g ^ g' 

Gh,h' >1 'ih ^ h' 


(55) 

(56) 

(57) 


''’This choice may appear mysterious, but notice that if we define D = C — Xntax{C)I — J 
and assuming Aniax(C) = ci we could write ( 151 ) as D = C2M ® D, which is more natural. 


15 








Then verification proceeds in a straightforward manner. For example, in the 
hrst case in fl54p we have 


Cgh,gh — Cl + 


> Cl - 


C2 




{Ch,h — Amax(C*) — 1) + 1 


C2A 

max 

l^(G)| 


+ 1 = 1 


because Ch,h > 1 and by ((52]). The two remaining cases are checked similarly. 


□ 


4. Proofs of main results 


Before going into details of the proofs, we make a clarifying remark. Our 
main goal is to improve the simple bound (I9|), which (we remind) was ob¬ 
tained by noticing that independent sets of H{k, ak) transform under (a, /?)- 
maps into independent sets of H (n, fin). The improvement comes by noticing 
that (a,/3)-maps also transform any matrix M in (|2T]) feasible for H{k,ak) 
into a matrix M' feasible for H[n,fin). Good feasible matrices for H{k,ak) 
were found previously in j^, 10]. We proceed to formal details. 


Proof (Theorems [Hand [ 2 ]). Clearly, it is sufficient to prove Theorem O 


21 , McEliece et al I™ and the 


We quote the following results of Kleitman 
joint lower bound of Samorodnitsky and Navon-Samorodnitsky 


— log {H{n,Xm)) = h{X/2) + 6m{>^) (58) 

m 

— log 6 s{H{m,Xm)) < Rlp 2 {X) + 5m(A) (59) 

m 

— log 9s{H{m, Am)) > Rsam{X) - 5m{X ), (60) 


where the remainder term 5rn{X) 0 uniformly on compacts in A G (0,1]. 

Take fi > e and k,n E Z + . Dehne 6 m = sup^^gj^ (jm(A). Assume 
that (1T3|) holds. Consider arbitrary / : —)■ F^. Notice that if S' is a set 
which does not contain any pair satisfying (lT5l) . then the set 


{{x,y) :xE S,y = f{x)} 
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is an independent set of H{k, ak) x H{n, fin). (This is also clear from (13 5 p as 
/ defines a homomorphism S H{n, (in) if S is viewed as induced subgraph 
of H{k, ak).) Thus it is sufficient to show 

{H{k,ak) X H{n,(in)) < 


This follows from the following chain: 


{H{k,ak) X H{n,(in)) < 2^ 


9s{H{n,Pn)) 
9s{H{k, ak)) 


^ 2k+nRLP2(l3)—kRsamio!)+nSn+kSk 


^ 2k(l—e)+nSn+kSk 


(61) 

(62) 

(63) 


where fl6Tp is from (jST]), fl62p is from fl5^ and fl60l) and fl6^ is from ([13]). 

If instead of flT^ the pair {a,(i) satishes flTTp then the argument is the 
same except in (l6Tp we should apply (l39p and (l5^ to get@ 

{H{k,ak) X H{n,lin)) < 2^+’^(i-’^M/5/2)+'5n)-fc(i-Ma/2)-4) 


and the rest of the proof is the same. 

Finally, to show the statement about the number of pairs satisfying flTsp 
dehne a graph G with vertices Fg and x ^ x' ii flT^ holds. We have already 
shown 

(G) < 

Then from Turan’s theorem we have 


\E{G)\ > 


ing)l ( \ViG)\ \ 

2 V (G) J 


^ 2k(l+e—Sk)-n5n. 


(after enlarging 6 ^ slightly). 


□ 


^Note that another result of Samorodnitsky 
factors we have 


22l . Proposition 1.2] shows that up to 


0L(iJ(m, Am)) Ri 9s{H{m, Am)) « u{H(jn, Am)) = . 

Therefore here we could still operate with 9s only and apply (l40)) . We chose to use (k’s 
because Kleitman’s theorem ()58p has explicit non-asymptotic form and thus for finite k,n 
results in a better bound. 
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Proof (Theorem The argument follows step by step the proof of The- 

oremOexcept that at fET]) we use the (almost) exact value of 6 s{H{n, d)) for 
d > n/2 found in the Lemma below. 


Lemma 10. For any A G (1/2,1) there exists 6n{X) >0 s.t. 

I - ^n{X) < Os{H{n, [AnJ)) 

2A 

< - . 

- 2A - 1 

Furthermore, 5n(A) —)■ 0 uniformly on compacts o/(1/2,1). 


(64) 

(65) 


Proof. We need to introduce the standard dehnitions from linear program¬ 
ming bounds in coding theory, cf. (ill. Ch. 17]. Any polynomial f{x) G R[a;] 
of degree < n can be represented as 


/(i) = 2-”5^/(i)A-j”>(i), 

j=0 

where Krawtchouk polynomials are dehned as 



and, for example, Kq^\x) = 1 , k["'\x) = n — 2x. 

It is a standard result j^. Theorem 3] that for the Hamming graphs the 
semidehnite program (|2T|) becomes a linear program. We put it here in the 
following form: 

9s{H{n,d)) 

= max |y|^ : / £ 0 , f(x) = 0,1 £ |l,o!] n Z,/(a:) > 0, 1 £ [0, n] n Z j 

(67) 

= ^^ < O.x £ M + 1.„| n Z.O(O) > o} (68) 

where / and g are polynomials of degree at most n. 
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The upper bound is a standard Plotkin bound (see [ll|, Ch. 17, §4]): 
taking g{x) = 2{d + 1 — x) we notice that 

g{x) = K^^\x) + (2(d + 1) - n)K^Q\x). 

Thus ^(0) = 2”(2(i + 2 — n) and we get for d = [AnJ 

«s(ff(n,d))<4h±lL< 


For the lower bound 


2d + 2 — n 2A — 1 
we assume that d = [AnJ, 

A G [1/2 — e, 1 — e] 


(69) 


and n is sufficiently large (for all small n we may take (5„(A) = 2X^)- 
hrst consider the case of d - odd. 

Consider the polynomial f{x) = 2“"' Y^^=o k'^\x) with coefficients given 
by 


f{u) = K^^^\u) + r 


n 


d + 1 


-1 




(70) 


where r G (0,1) is to be determined. To compute values of this polynomial, 
we employ the orthogonality relation for Krawtchouk polynomials, cf. j^, 
(34)]: 

n 

= 2”l{x = £}, Wx, £ G [0, n] n Z 

a ;=0 

From here we get 


1, a: = 0 

/(^) = f ' l .:.)"'. ^=‘‘+1 

0, all other x G [0, n] n Z . 

We note that this fix) was guessed by studying Levenshtein’s codes that 
attain Plotkin bound jlll . Chapter 2, Theorem 8]. 

To verify that f{x) is a (asymptotically!) feasible solution of fl^ we 
need to check f{oj) > 0. First, let m = n — d — 1 < n/2 and notice that 24, 
(31)-(32)] 

(a,) = (-l)"/s:M(a,) = - uj). 
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Therefore, since n — m is even it is sufficient to verify 

r \m j 


( 71 ) 


for all a; G [0,n/2] fl Z. For w = 0 this is obvious, for a; = 1 we have [24. 

(13)] 

n \m, 


and thus taking 


n 


r = 


n — 2m 

makes fTfTll hold at ca = 1. 

It is known that Km\x) has m real roots with the smallest root Xi sat¬ 
isfying 0, (71)] 

Xi> — — \/m{n — m). (72) 

Therefore, polynomial Km\x) is decreasing on (—oo, Xi] and hence flTT]) must 
also hold for all odd oj G [l,xi] (for even oj < xi, inequality fl7T]) holds just 
by considering the signs). In view of fl72|) we only need to show flTTl) for 
< u < n/2, where 

f = l-yA(l-A). (73) 

In this range, we will show a stronger bound 


r \m 


(74) 


The following bound is well known (ril (87)Jj: 


\Ki\ix)\ < 25 


1 __ 1 _ 

n f 2 


mj \(jj 

Note that by the constraint fl69|) ^ is bounded away from 0 and thus we can 
estimate 

' n\ I n' 

\uj, 


-1 




'To get an explicit estimate on 6n{X) in (j64|) . we could use the non-asymptotic bound 


25l . Lemma 4], which also holds for uj < ^n. 
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for some sequence that only depends on e. Thus comparing the exponents 
on both sides of (ITT]) we see that it will hold provided that 


r-2 y 2'^(^-^W+^(0)+nSn 


(76) 


But notice that by the exponent in parenthesis is exactly the gap between 
the Gilbert-Varshamov bound 1 — h(l — A)) and the hrst linear programming 
bound Rlpi{1 — A), cf. (jb]). There exists e' > 0 separating these two bounds 
for all A’s in fl69|) . Thus, the right-hand side of fl75|) is exponentially decreas¬ 
ing 2“'^ n+n5„ hence for sufficiently large n it must hold. This completes 
the proof that f{x) in flTD]) is a feasible choice in fE7|) . Therefore, we have 
shown that for all n sufficiently large 

Os(.H(n,d))>l + r= 

2 d + 2 — n 


if d is odd and 

es{H{n, d)) > es{H{n, d + 1)) > ^ 


if d is even. 


□ 


Proof (Corollaries [Hand [5]). Assume to the contrary that one found 
a, [3 and Ui,... ,Uk,Vi,... ,Vn € p™-”! s.t. there is no hyperplane satisfy¬ 
ing ([19]). Then as explained in Section 15.51 below (see (IHTIB . there is an 
independent set of size 2™ in H{k, ak) ^H{n, jdn). By inspecting the proofs 
of Theorem [2| and [3] we notice that they prove three different upper bounds 
on {H{k, ak) Kl H{n, fdn)) that are equal to exponentiation of the left-hand 
sides of flT7|) . fiT8|) and fl20l) respectively. Therefore, m cannot satisfy any 
of flT7|) . flT8|) or fl20|) - a contradiction. □ 


5. Discussion and open problems 


5.1. Evaluation 

In this section we evaluate our bounds, 
setting k ^ oo and n = pk where p is hxed. In Fig.|l(a)|(p = 3) and Fig. |l(b) 


We consider the asymptotic 


(p = 1/3) we plot the various bounds on the region of asymptotically feasible 
pairs {a, (3): 
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(a) p = 3 (b) p = I 


Figure 1: Bounds on minimal possible a for a given /? S (0,1) in the asymptotics n, fc —>■ oo 
and f = P- 

• For p = 3 the lower bound for 0<Q!<l/2is ffTOj) from Theorem [H for 
1/2 < a < 1 is Theorem 131 

• For p = 1/3 the lower bound (for all a) is flTT]) . In this case the other 
two bounds, flTOj) and flT^ . are strictly worse. 

• For p = 3 the straight dashed line denotes performance of the repetition 
map dH). 

• For p = \ the straight dashed line denotes performance of the majority- 

vote map. Namely / : —)■ F 2 gives a majority vote for every one of 

3-bit blocks. It is clear that for all x, x' we have: 

|/(x) —/(x')| </9n |x — x'l < 

Indeed any pair of 3-bit strings for which majority-vote agrees can be 
at most Hamming distance 2 away (as 001 and 010). 

• Finally, the curved dashed line corresponds to the separation map de- 
hned as follows. Fix a G (0,1) and cover F 2 with balls of radius a/c/2. It 
is sufficient to have 2 ^d-^(«/ 2 ))-i-o(fc) balls. Also consider a packing 
of balls of radius fin/2 in F^. By Gilbert-Varshamov bound we know 
that we can select at least 2”d-^(/3))+o(n) g^j^b balls. Thus whenever 

k(l — h{a/2)) -b o{k) < n{l — h{/3)) -b o{n) 


22 









we can construct the map f : ^ that maps every point inside an 

ak/2 ball to a center of the corresponding packing ball. Clearly, such 
map will be an {a, (3) map. Thus, asymptotically all pairs of {a, (3) s.t. 
(3 <1/2 and 

1 - h{a/2) > p{l - h{l3)) 

are achievable. 


Note that as /3 ^ | the bound (fTOj) becomes: 

a> +o(l-2/3), /3 




This is a signihcant improvement over what the simple bound 

1 


" - 2 


P 


— -(1 - 2/3) log2 --— 

2 log 2 e 1 — 2p 


(76) 


yields: 
1 


+ o(h((l/2-/3)^)), [3^ 


In particular, fl76|) has finite slope at a = (3 = \ and furthermore as p \ 1 the 
slope-discontinuity at (1/2,1/2), see Fig. 1(a) disappears. This last effect is 
a consequence of the Navon-Samorodnitskv |lfll| part of the bound (IT^ . 


5.2. On list-decodable codes 

One of the more interesting conclusions that we can draw from our bounds 
is the following. It is well known that there is only finitely many balls of ra¬ 
dius > n(l/4-|-e) that can be packed inside Fl/ without overlapping (Plotkin 
bound). However, if one allows these balls to cover each point with multi¬ 
plicity at most 3 then it is possible to pack exponentially many balls j^. 
Thus, if one is allowed to decode into lists of size 3, it is possible to withstand 
adversarial noise of weight 1/4 -|- e while still having non-zero communication 
rate. 

By setting (3 = 1/2 -|- 2e and applying Theorem [3] we hgure out, however, 
that no matter how the balls are labeled by fc-bit strings, at least one ball 
of radius 1/4 -|- e will contain a pair of points whose labels differ in at least 
(1/2 -|- 2e)fc positions. So although list-decoding allows one to overcome the 
1/4 barrier, there is no hope (in the worst case) to recover any information 
bits from the labels. This is only true beyond the radius 1/4, since of course, 
below 1/4 one can use codes with list-1. Loosely speaking, we have a “phase- 
transition” in the communication problem at noise-level 1/4. 
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5.3. Linear programming bound 

It is possible to write a linear program for 6 s{H{k,ak) >< H{n,(3n)) sim¬ 
ilarly to the standard Delsarte’s program fl67|) - fl68l) . To that end, for an 
arbitrary polynomial f{x,y) of degree at most k in x and at most n in y we 
can write it as 

k n 

fix, y) = 2-"-‘ Yi E /('> j)Kf\x)Kf(y), 

1=0 j=0 

where Kf^\x) and Kj'^\y) are Krawtchouk polynomials flBB]) . With this 
dehnition of the Fourier transform / we have: 

6 s{H{k,ak) K H{n,l3n)) 

= max I : / > 0, /(x, y) = 0V(a:, y) eV\ (0, 0) | (77) 

= min : ^ > 0, g{x, y) < 0, V(x, y) eV^\ (0, 0) | (78) 

where f,g are bi-variate polynomials of degree at most {k,n), and 

V = {(x, y) : X E [0,k]nz,y E [0, n] fl Z, (x = 0, y 7 ^ 0) or (x > ak, y < (dn)} 

(79) 

= {{x,y) : X E [0,k]nz,yE [0,n] fl Z, (0 < x < ak) or {x ^ 0,y > (dn)} 

(80) 

The bound used in Theorem [2] states 

9s{H{k,ak) x H{n,(dn)) < 2 ’^+^^^p^^^'^-^^sam{a)+o{n)+o{k) 

This bound corresponds to the following choice of g{x,y) in (I78|) : 

9{x,y) = fi{x)gi{y ), 

where /i(x) is the Samorodnitsky assignment in the primal for 0s{H{k^k)) 
and gi{y) is a standard choice of McEliece-Rodemich-Rumsey-Welch [6| in 
the dual for 6 s{H{n, (dn)). In fact, any primal /i and any dual gi give a 
candidate for g{x,y). Thus, we have 

OsiHik, ak) K H(n, jdn)) < . 

^ ^ ^ ^ F- j^(o)^i(0) 
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Optimizing over all fi and gi we get 


es{H{k,ak) K H{n,l3n)) < 2^ 


6s{.H{n,l3n)) 
9s{H{k, ak)) 


(This, of course, is exactly how the bound was obtained in Lemma [6l) 

We were not able to hnd any choice of g{x,y) in the dual problem (l78|l 
that beats the product f{x)g{y). This seems to be the most natural di¬ 
rection for improvement. Another open problem is to hnd an upper bound 
on {H{k,ak) x H{n,(3n)) that does not follow from an upper bound on 
{H{k,ak) H{n,(3n)) or to prove that these are asymptotically equiva¬ 
lent. 


5.4- On repetition & majority-vote 

By looking at Fig. 1(a) we can see that relaxation of the minimum- 
distance property, cf. Def. [H that we consider in this paper allows one 
to have non-zero rate even at “minimum distance” > 1/2. However, in 
this case a > f3 (Theorem [3]) and furthermore repetition map ([T]) is optimal 
(provided n/k G z). This raises a number of questions: 


• Can one show that any (Q;,/3)-map in high-/? regime is structured sim¬ 
ilarly to a repetition map? 

• For the case when n/k ^ Z (e.g. p = 3/2), how do we asymptotically 
achieve a ~ /3? 

• The corresponding situation with majority-vote maps is even worse, 
here we need ^ be an odd integer. What is the counterpart for even 

• Finally, how do we smoothly interpolate between the “non-smooth” 
separation construction (that is not even injective) and the repetition 
map? 

In fact the last question was our main practical motivation for looking 
into the concept of (a, /3)-maps. We do not have any good candidates at this 
point. 
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5.5. On linear codes 

A natural approach to construct good {a, (3) maps is to restrict to linear 
maps / : F 2 —)■ F^. A linear / is {a, (3) if 

|a;| > ak |/(3^)| > ■ 

Instead of working with this condition, we get a more invariant notion by con¬ 
sidering the graph of / that is just a linear subspace of L C F 2 '''"'. Different 
conditions can be stated on L that will ensure that L dehnes an (a,/3)-map, 
or that it gives an independent set in H{k, ak) k H{n, f3n), or even an inde¬ 
pendent set in H{k, ak) H{n, (3n). 

We state these conditions for a general held F and also in a geometric lan¬ 
guage of j^. The extension of the concept of an {a, /9)-map, cf. DehnitionlH 
and Hamming graphs Hp{n,d), cf. (E]), to arbitrary held F is obvious. 
Suppose that we have (not necessarily distinct) points 

Ml, . . . ,Mfc,Mi, . . .M„ e 

where is a projective space of dimension m — 1 over the held F. For 

every codimension 1 hyperplane H dehne 

Z,{H) = #{j : V, e H], Z^{H) = #{* : u, e H} . 

By writing these two collections of points in homogeneous coordinates we 
get a m X {k + n) matrix over F, whose row-span gives the linear subspace 
L C We then have the following statements: 

1. If points {ui,Vj,i G [k],j G [n]} are not contained in any (codimension 
1) hyperplane H C and satisfy 

'iH : Z^{H) >{l-(3)n k> Z^{H) > (1 - a)k 

then 

{Hp{k, ak) M Hp{n, I3n)) > iF^ . (81) 

2. If points {ui,i G [k]} are not contained in any (codimension 1) hyper¬ 
plane H C p"*“^ and 

yH : Z^{H) > (1 - /3)n =» Zu{H) > (1 - a)k 

then 

{H^{k,ak) X Hp{n,/3n)) > If]™ (82) 

(note that assumption implies k > m here). 
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Figure 2: Construction of the optimal (|, |; 3,4)-map by selecting seven points on the 
binary projective plane. 


3. If in addition to previous assumption we also have k = m, i.e. points 
{ui,i G [fc]} span then there exists a linear (a,/3)-map and thus 

Hp {k, ak) Hp (n, l3n). 


Note that if span and a = 0 then condition (18^ simply states 
that one cannot include more than (1 — /9)n points from {vj,j G [n]} into 
any hyperplane - i.e. a standard geometric condition for [n, fc, djg-systems, 


cf. 27|. Similarly to how [n,k,d]q systems exactly correspond to [n,k,d]q 
linear codes, existence of points {ui,Vj} satisfying (IHTj) and assumptions in 
item 3 is equivalent to existence of an F-linear (a,/?; /c,n)-map. 

As an example, consider F = F 2 . We will construct a linear map f| —)> F 2 
by selecting seven points on the binary projective plane P^: mi, ^ 2 , us are any 
points spanning P^, 

Vi = Ui,V2 = U2,V3 = U3 


and hnally put V 4 to be the only point not contained in any of the lines 
(^ 1 ,^ 2 ), {v 2 ,V 3 ). See Fig. [2] for an illustration. It is easy to see that 

condition (152]) holds with « = | and (3 = j, thus 




Computing (1751) with smaller a and larger 13 shows that the code of Fig. [2] is 
optimal. 
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